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DIGITAL IMAGING 

Background of the Invention 

The present invention relates to digital 
particularly to contrast and edge enhancement 
imaging. 



imaging technology, and more 
in still and moving digital 



Digital imaging offers a great many advantages over traditional analogue 



10 techniques, supporting services such 



as video telephony and multi-media 



applications. Accordingly, digital imagir g is currently the subject of extensive 
research. 

One particular area of digital imaging re search is that of image enhancement. 

15 In digital imaging, there is need for inage enhancement because images 
typically suffer from various types of degradation, such as lack of sharpness, 
noise, compression artefacts, and poor contrast and brightness. Mobile 
imaging products presently under development are especially prone to such 
degradations due to the low perfonman; 

20 and the narrow data transmission bar < 
communications networks, which requires 
In digital camera products, poor image 
fundamental sensor properties. The lack 
sensor itself, while the lack of sharpness 

25 and low sensor resolution. Low resolution 

imaging systems of forthcoming first generation mobile telecommunication 
terminals with image presentation and manipulation functionality. Thus, there 
fs a need for methods to enhance image contrast and sharpness, and in 
current digital image enhancement techniques this is commonly carried out by 

30 concealing artefacts and reconstructing degraded parts of an image. 



e of current digital camera devices 
dwidth typically available in mobile 

the use of high compression ratios, 
quality arises from shortcomings in 
of contrast typically arises from the 
s the result of both low quality optics 

sensors are likely to be used in the 
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Image enhancement principally concerns 
as edges, boundaries, or contrast. This 
makes images look subjectively 
unnatural, therefore making a graphic c 
analysis. Whilst the enhancement 
information content in the data, it does ij 
features so that they can be more easily 



shaner 



process 



Image enhancement techniques can be di 
comprising point, spatial, and transform operations 



accentuation of image features such 
rrjiakes image details more visible and 
or crisper without appearing 
isplay more useful for display and 
does not increase the inherent 
the dynamic range of chosen 



increase 



detected. 



vided roughly into three sub-classes 



Point operations are performed on individual 
independent of surrounding pixel values 
example of point operations. Pixel mapping 
a new value with a function, for example 

where 

j\ j = pixel's coordinates 
y = output pixel 
x — input pixel 

and f is a function relating xand y. 



Spatial operations are performed on 
smoothing and filtering functions are spatikl 
pixel's value may be modified by takinci 
values. 



pixels and as such are 
Pixel mapping operations are one 
involves mapping a pixel value to 



groups of pixels. Certain image 
operations where, for example, a 
an average of surrounding pixel 



25 Transform operations convert image data from pixel values into another form, 
for example spatial frequency components. Discrete cosine transforms (DCT) 
and wavelet transforms are examples of transform operations commonly used 
in image processing applications. 
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Examples of enhancement techniques! in the sub-classes outlined above 
include techniques such as grey level and contrast manipulation, noise 
reduction, edge crispening and sharpening, filtering, interpolation and 
magnification, and pseudo-colouring. 

In practice, images taken by a digital cart era normally suffer from smoothness 
problems irrespective of the pixel resoluton. This means that there is always 
likely to be a need for image sharpening techniques. Image sharpening can 
be performed by applying various forms of contrast enhancement {stretching / 

10 shrinking) and edge enhancement techniques. Contrast enhancement is a 
point operation that can be used to enhance images taken in poor or non- 
uniform lighting conditions, or acquired wth an imaging sensor having a small 
dynamic range. Contrast manipulation also tends to alter the visibility of 
edges, which changes the perceived sharpness of the image. Edge 

15 enhancement techniques are typically spatial operations and they enhance 
images that suffer from overall smoothness. A technique known as unsharp 
masking is an example of an edge enhancement technique. 

Referring first to contrast enhancement, a well known method for enhancing 
20 contrast is histogram-based pixel mappirg, In this method a pixel-mapping 

function is formed utilising a histogram o 

The histogram contains the number of pixel occurrences at each level of the 

input signal range. The mapping function is derived from a cumulative 

histogram so that it has high slope co 
25 histogram. The cumulative histogram is 

having the form: 



where 

C\ = bin i of cumulative histogram 
H k = bin k of histogram 



responding to high values in the 
typically formed using an equation 
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that may cover a single pixel value or 



on is: 



Note that a bin is a pixel value range, 
more than one pixel value. 

In the basic method the mapping functi 



The mapping function or the cumulative histogram is typically scaled so that 
the mapping covers substantially exactly the available dynamic range, i.e.; 



f(L) = L, 
where 

L = largest value of the available dynamic 



iiuntge 



The scaling is achieved, for example, 



15 f(x) = L-f- 



using equation; 



The above equations can be found 
processing textbooks. For example 
nonzero bin is subtracted from the histogram 
the cumulative histogram. If such a 
pixel value of the image is not mappe|d 
also exist. 



The above equations are usable substantially 
as signal levels, for example, 256 
bits/sample. If fewer bins are used, 
certain signal range. The above equations 
at the borders of bins. Additional valu =>s 



i slightly varying forms in many signal 
in one alternative approach the first 
before or during computation of 
Subtraction is not performed the darkest 
to zero (C 0 *Q). Other modifications 



only if there are as many bins 
bins are required for a signal with 8 
ach bin contains pixels belonging to a 
provide mapping function values 
may be obtained by interpolation, 
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histogram and corresponding mapping 



^lope equal to on© produces no change 
n also be non-linear, having a varying 
slope. In this case contrast around some pixel values of the image is 



10 increased, the contrast in other pixel 



value ranges may be decreased or not 



altered at all. An example of a nop-linear mapping function is shown in 
Figure 2. 



ram- 



An acknowledged limitation of histog 
to make noise and other artefacts 
contrast increases the visibility of variations 
present in the input signal, its visibility 
histogram-based pixel mapping is oftein 
enhancement of natural images. 



based pixel mapping is that it tends 
disturbingly visible. Because increasing 
in the input signal, if there is noise 
is also increased. Because of this, 
considered unsatisfactory for contrast 



Nevertheless, histogram-based pixe 
number of contrast enhancement a 
a mapping function based on the i 
mitigate the unwanted effects of 
modifications and additions to the 
include, for example, reshaping 
function, filtering the image, the 
limiting the maximum value of the 



Turning now to edge enhancement, 
masking, this is a spatial filtering technique 
and thus improving perceived image 



techniques, the contrast of an image 



Examples of a histogram, a cumulative 
function are presented in Figure 1. 

Using histogram-based pixel mapping 
can be increased by mapping input pi<el values to output pixel values with a 
linear function having a slope (i.e. derivative) greater than one. A slope less 
than one decreases contrast, while a 
in contrast. The mapping function c 



mapping is the basis for a substantial 
Igojrithms. So, whilst these algorithms form 
image histogram, attempts are made to 
the basic mapping procedure using 
sasic algorithm, These modifications 
th|e histogram, reshaping the mapping 
histogram or the mapping function and 
histogram. 



specifically in the context of unsharp 
for improving the visibility of edges 
quality. Unsharp masking is commonly 



6 



second 



implemented in the form of a highpass 
block, as shown in Figure 3. In the 
filtered and scaled image signal is 
shown in Figure 4a. Thus, the 
emphasising high frequency components 
of the highpass filter represents a 
signal, as represented in Figure 4b. 
added back to the original signal, rt 
edges as shown in Figure 4c. The 
under and overshoots around sharp 
the Mach band effect. It demonstrates 
perceives edges in a non-linear manne 
on luminance but also on image structure 
system perceives edges with added 
produced by unsharp masking, as s 



filter in series with an adjustable gain 
illustrated arrangement, a highpass 
added to the original image signal as 
desired improvement is achieved by 
of the image. Specifically, the output 
order derivative of the original 
When the highpass filtered signal is 
creates under and overshoots around 
human visual system itself creates similar 
edges, This phenomenon is known as 
that the human visual system 
r, and that perception depends not only 
. For this reason, the human visual 
under and over shoot, such as those 
harper edges. 



Unsharp masking also tends to 
presence of a highpass filter make 
compression artefacts. Thus, 
perceivable artefacts, which are esp 
image. 



nput 



Accordingly, it has been recognised 
would be appropriate to modify an i 
when there is a noise componen 
modification, known in the art, is to u 
mapping function prior to unsharp ms 
mapping function, it is possible to e 
unwanted noise enhancement. Figunp 
that utilises pixel mapping prior to 
arrangement, a pixel mapping functioih 



produce some undesirable effects. The 
s the system sensitive to noise and 
unsharp masking typically produces 
ecially visible in uniform areas of an 



tiat 



se 



in order to improve image quality it 
signal of the highpass filter, especially 
present in an image. One such 
a standard, predefined, or fixed pixel 
sking. Using a conventional fixed pixel 
mphasise certain edges, whilst limiting 
5 depicts an unsharp masking scheme 
highpass filtering, In the illustrated 
is applied to the image before unsharp 
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masking in order to limit the unwantod enhancement of noise components 
that occurs as a result of high-pass filtering. 



Figure Q shows two possible pixel mapping 
prior to unsharp masking. Curve 1 
stretches mid-range pixel values. Accordingly 
low level edges are suppressed and 
2 mid level edges are suppressed 
enhanced. In this way, the effect of 
filtering is to reduce noise. 



The effect of a function such as Curve 



function curves suitable for use 
?s high and low level signals and 
, in the highpass filter, high and 
level edges are enhanced, (n Curve 
and high and low level edges are 
using pixel mapping prior to highpass 



mid 



1, shown in Figure 6, is illustrated in 



Figure 7. This shows the effect of applying a conventional fixed pixel mapping 
function to an image that contains a single 'edge'. Here the edge is a 
transition from dark to light i.e. from very low intensity pixel values to very high 
intensity pixel values. In other words, the image contains just two regions, 
one of low luminance values and one or high luminance values, as shown in 
Figure 7a. Figure 7b presents a graph of pixel values created by scanning 
across a row of pixels from left to right. It is assumed that the two regions, 
which should be of essentially uniform intensity, exhibit some degree of noise. 
The noise manifests itself as small variations in pixel value (as can be seen 
from the Yipple' in Figure 7b). By applying the fixed pixel mapping function 
illustrated in Figure 7c, the noise in the image of Figure 7b can be suppressed 
effectively. The result of the fixed pixsl mapping function is illustrated in 
Figure 7d. The way in which the noise ts suppressed can be understood by 
examining the pixel mapping function in detail. It should be appreciated that 
the pixel mapping function describes the way in which pixel values in the 
original image (i.e. that described by F igure 7b) are converted into pixel 
values in the contrast enhanced (adjusted) image, whose pixel value profile is 
illustrated in Figure 7d. Considering first reduction of noise in the low intensity 
region of the image, the relevant part ol the pixel mapping function is that 
labelled TV in Figure 7c. This part of the| pixel mapping function determines 
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how low intensity pixel values in the original image are translated into low 
intensity pixel values in the contrast enhanced image. Here the pixel mapping 
function has a gradient less than 1, indicating that variations in pixel value will 
be reduced (or 'compressed') by applyir g the function. The same is true in 
region "B" of the pixel mapping function of Figure 7c. This part of the curve 
determines the way in which high intensity pixel values in the original image 

ues in the contrast-enhanced image, 
extremes of the range. Referring to 



are translated into high intensity pixel val 
Thus, noise is effectively reduced at both 
how mid-range intensity values are conve rted by the pixel mapping function in 

10 this example, the part of the function labelled 'C has a gradient greater than 1 
and therefore, the range of pixel value 
enhanced (expanded or stretched), changing the profile of the transition 
between low and high intensity values However, this effect cannot be 
considered as a true sharpening of the transition, such as that provided by 

15 unsharp masking. Contrast expansion has the effect of enhancing the 
difference between nearly identical mic -range pixel values and inevitably 
enhances the effect of noise in the pixel v alue range around the transition. 

The use of conventional fixed pixel mapphg functions in order to condition an 
20 image prior to unsharp masking has certain limitations. These will be 
described with reference to Figure 8, whbh illustrates the effect of using the 
same pixel mapping function, introduced above, to enhance the contrast of a 
second example image, As in the first example, the image considered in 
Figure 8 is a very simple one, comprising two substantially uniform regions, 
25 one darker than the other (Figure 8a). The difference in intensity values 
between the two regions is less than in tte previous example, although the 
same kind of noise is present (Figure tib). The effect of the fixed pixel 
mapping function is illustrated in Figure 8d. While noise in the darker region 
is suppressed, noise in the lighter region is actually enhanced. This effect 
30 occurs because the pixel values of the lighter region correspond to a region of 
the pixel mapping function that has a gradient greater than one. Thus, small 
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differences in pixel value are enhanced, rather than suppressed, causing an 
increase in noise, 



It is common that images are processec 
pixel mapping contrast algorithms and 



using both (fixed or histogram-based) 
unsharp masking edge enhancement 



algorithms. Referring to Figure 9, the combination of histogram -based pixel 
mapping and unsharp masking can be implemented by placing the histogram- 
based pixel mapping in the original image signal branch before (Option A), 

B) with an edge enhancement unit, 
ions, such as certain commercially 



after (Option C), or in parallel {Option 
Commonly, image processing applicati< 
available software packages, implement options A or C> giving rise to a 
cascaded structure. However, it has been found that the best results are 
achieved by option B, in which a histogram-based pixel mapping unit is placed 
inside the unsharp masking unit, that is in the original image signal branch, in 
parallel with the highpass filter and not h cascade with it as in options A and 
C. In option B t any unwanted noise component that is emphasised by 
contrast enhancement, is not highpass filtered and thus not further 
emphasised. In both options A and C the second operation in the cascaded 
structure further emphasises noise artefacts introduced by the first operation. 
Here, the second operation refers to the latter operation, i.e. in option A, the 
second operation is unsharp masking, and in option C the second operation is 



histogram-based pixel mapping. Thus, 



disadvantage that noise is 'doubly' enhanced. This can create very annoying 



noise structures, especially if a JPEG or 



25 used to compress the original source image. For example, assuming option A 



is used, initial contrast enhancement cau 
noise. This is further exaggerated by the 
using e.g. unsharp masking. In the cas4 



the cascaded approach has the 



DCT based hybrid codec has been 



5es a certain increase in pixel value 
following step of edge enhancement 
of option C, because the unsharp 



masking emphasises edges it also heightens noise around edges. The 
amplitude of this noise is then further increased by the histogram-based 
contrast enhancement. Also, other artefacts caused by the unsharp masking, 
for example ringing effects may becorjne more visible. The approach 
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illustrated by option B, on the other har|d 
Here, contrast and edge enhancement 
pass filtered image is added to the con 
the addition symbol in Figure 9). 



, avoids double noise enhancement, 
are performed in parallel and the high 
rast enhanced image (as indicated by 



Nevertheless, the combined image enhancement 
from the problems associated with contrast 
described above. 



Summary of the Invention 

Against this background, and in one aspect 
method for image enhancement of a digital 
pixels, the method comprising applying 
function to the image pixels. 



The inverse histogram-based pixel 
in connection with any of options A 
particularly preferred embodiment, 
applied in connection with option B 



inverse 



-bas^id 



Alternatively, an inverse histogram- 
connection with any image processing 
histogram-based pixel mapping function 
image processing function that tend 
preferably, the inverse histogram-based 
pre-processing step prior to an image 
enhance noise visibility. 



In a preferred form of this aspect of the 
pixel mapping step is combined with 
unsharp masking. In such an arrangement 



options of Figure 9 suffer 
and edge enhancement previously 



, the present invention resides in a 
mage comprising a set of image 
an inverse histogram-based mapping 



mapping function can be applied alone, or 
B and C described above. In a 
histogram-based pixel mapping is 



pixel mapping function is applied in 
function. Preferably, the inverse 
is applied in connection with an 
s to enhance noise visibility. Most 
pixel mapping function is applied as a 
processing function that tends to 



invention, an inverse histogram-based 
edge enhancement step, such as 
the inverse histogram-based pixel 



an 
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mapping step improves the performance 
has an advantageous effect on 
unsharp masking techniques, 



3 of the unsharp masking step. It also 
combinations of contrast enhancement and 



As explained earlier, unsharp masking techniques augment the subjective 
sharpness of an image by adding overshoot and undershoot components to 
edges within an image. The effect of ir verse histogram-based pixel mapping 
is to change the pixel values according to their frequency of occurrence. In 
embodiments in which the inverse histogram-based pixel mapping step is 
combined with an edge enhancement step, such as unsharp masking, the role 
of the inverse histogram based pixel mapping is to act as a pre-processor for 
the highpass filter unit inside the edge) enhancement unit, that alters pixel 
values in such a way that noise enhanc4ment introduced by subsequent edge 
enhancement is reduced. 

This arrangement serves to minimise the amptificaton of noise components, 
while desired signal components are enhanced. More specifically, inverse 
histogram-based pixel mapping produces a reduction in contrast at signal 
ranges containing a large number of 
elsewhere. Thus, noise is suppressec 
subjectively most visible. It has been found that the effect is substantially the 
same when inverse histogram-based pixel mapping is applied to: a) a large 
uniform area, and b) an area containing a large number of pixels having a 
small number of different values (e.g. a speckled region) 

According to the first aspect of the invention, there is also provided a device, 
such as a portable radio communication device, comprising means for 
performing said image enhancement metiod. 



pixels and an increase in contrast 
in e.g. uniform areas, where it is 



According to the first aspect of the indention 
software program, comprising machine 
processor unit to perform said image 



, there is further provided a 
readable instructions for causing a 
enhancement method. The first aspect 
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of the invention also extends to a software program product stored on a 



medium and configured to perform said 



image enhancement method. 



According to a second aspect of the 
image enhancement of a digital image 
method comprising applying, in a brand}) 
parallel to an original image branch 
function to said set of image pixels 
branch. 



indention, there is provided a method for 
comprising a set of image pixels, the 
of an edge enhancement unit that is 
a histogram-based pixel mapping 
pridr to applying a highpass filter in said 



As described earlier, use of a fixed pixel mapping function in connection with 
unsharp masking prior to high-pass filtering is known, as illustrated in Figure 
5. This has the disadvantage that such a function can only be chosen to 
enhance contrast in certain pixel valu^ ranges, Furthermore, its effect on 
noise components in the image varies according to the nature of the image, 
as evidenced by the description of Figures 7 and 8. Accordingly, the inventors 
have noted that because the function illustrated in Figure 6 is constructed 
artificially it cannot be altered to adapt to image content and is therefore not 
optimal for all images. 



recognised 



with 



In contrast, the inventors have n 
pixel mapping function is constructed 
adaptive to image content and hence so 
enhancement can be reduced. 



that because a histogram-based 
reference to the image itself, it is 
ne of the problems relating to noise 



Used in conjunction with edge enhancement 
such that once a histogram of pixel 
determined, the profile of the histogram 
nature of the pixel mapping function creat 



, the histogram can be adapted 
/alues within an image has been 
be altered in order to change the 
3d from it. 
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Brief Description of the Drawings 

Referring now to the accompanying 
conjunction with an account of the prior 
Figure 1 shows a histogram and correspond 



drawings, Figures 1 to 9 are used in 
art in which; 

ing mapping function; 



Figure 2 illustrates a non-linear mapping function; 

Figure 3 shows a block diagram of an upsharp masking scheme; 

10 Figure 4 illustrates the effect of an unsharp masking scheme on an edge of an 
image signal; 



Figure 5 shows an unsharp masking 
prior to a highpass filter of the unsharp 



Figure 6 illustrates two possible curves c f a pixel mapping function of figure 5; 



scheme 



n 



with a fixed pixel-mapping unit 
asking scheme; 



Figure 7 shows the fixed pixel mapping 
noisy image; 



function applied to an edge in a first 



Figure 8 shows a fixed pixel mapping function applied to an edge in a second 
noisy image; 

Figure 9 shows possible locations for a contrast enhancement unit 



described 



The present invention will now be 
reference to the accompanying drawings 

Figure 10 illustrates one embodiment 
30 invention; 



, by way of example only, with 
in which; 

of the first aspect of the present 
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Figure 11 illustrates an inverted his 
embodiment of Figure 10; 



ogram constructed according to the 



Figures 12, 13 and 14a-e show alternate arrangements of the first aspect of 
5 the present invention; and 

Figure 15 shows an embodiment according to a second aspect of the 
invention. 



resides in the provision of an inverse 
9 for enhancing a digital image. As is 



1 0 Detailed Description of the Invention 

The first aspect of the present invention 
histogram-based pixel mapping technique 
well known, a digital image comprises an array of pixels. In the case of a 
monochrome image, each pixel has a pixel value within a certain range (e,g. 0 

15 - 255), which denotes the pixel's luminance, In a colour image, pixel values 
may be represented in a number of different ways. In a commonly used 
representation, referred to as the RGB colour model, each pixel is described 
by three values, one corresponding to the value of a Red colour component, 
another corresponding to the value of a G reen colour component and the third 

20 corresponding to the value of a Blue colour component. Numerous other 
colour models exist, in which alternative representations are used. In one 
such alternative model, known as the YUV colour model, image pixels are 
represented by a luminance componert and two chrominance or colour 
difference components, each of which 

25 Generally, colour models that employ 

components provide a more efficient representation of a colour image than 
the RGB model. It is also known that the luminance component of such colour 
models generally provides the most information about the perceived structure 
of an image. Therefore, application of 

30 according to the colour model used to 
example, in an image represented using 



has an associated pixel value, 
luminance and colour difference 



the present invention may vary 
represent a particular image. For 
i he RGB colour model, the method 



20-DEC, ' 00 (WED) 12:59 



FAX:01252865080 



P. 021 



10 



15 



25 



according to the invention may be alpplied 
components. On the other hand, if an 
model, it may be more efficient, for example 
the invention to just the Y component 
according to the invention can be 
combination (including just one) of 
model. Thus, it should be appreciated 
essentially insignificant for application 
used to construct the inverse histogram 
applied to any colour model comprising 



tlie 



to one, two, or all three colour 
image is represented using the YUV 
( to apply the method according to 
However, in general, the method 
applied to all components, or any 
components of a particular colour 
that the choice of colour model is 
of the invention, as the basic principles 
-based mapping function can be 
any number of components. 



Whilst this invention can be used in isolation to operate on an image, it has 
been found that it provides particularly beneficial results when used with any 
image processing function that tends to increase noise visibility. The 
approach of the present invention, as well as being a method, resides also in 
a device that includes means for applying inverse histogram-based pixel 
mapping to a digital image. In a specific context, the device may be a mobile 
telecommunications terminal, such as a mobile phone, that has the 
conventional radio frequency, hardware and software means normally 



20 required of a mobile phone and that 



capability and / or image capturing ard display means. Alternatively, the 
device may simply be a computer equipped with digital image processing 
means implementing the method according to the invention. In the former 



is equipped with image processing 



case, the mobile terminal is able to mak^ 
transmission of a captured image, and / 
display on the mobile terminal. 



use of the present invention prior to 
or for processing received images for 



Referring initially to Figure 10, there is 
histogram-based pixel mapping unit that 
30 for a highpass filter unit inside an ur 
histogram-based pixel mapping unit is 



spown one embodiment of an inverse 
s provided as a pre-conditioning unit 
sharp masking unit. The inverse 
isposed in series with the highpass 
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filter that is inside the edge 
loop that is parallel to the original image 



enhancement unit and both are in a branch or 
signal branch. 



tie 



The inverse histogram-based pixel mlapping 
example, by Inverting an image histogram 
histogram from the maximum value of 
illustrated in Figure 11. A standard his 
and the maximum value of the histog 
the histogram is subtracted from this 
histogram is created. Finally, the im 
function is derived from the cumulative 
histogram, the mapping function is folrmed 
used in the conventional histogram-bas 
appreciated that the inverse histogram- 
inverse function in a strict mathematica 



function can be formed, for 
and then subtracting the inverted 
original histogram. This method is 
ogram is first obtained from an image 
Is determined, Then, every value in 
maximum value, Next, a cumulative 
erse histogram-based pixel mapping 
histogram. After inversion of the 
in a manner analogous to that 
sd pixel mapping method. It should be 
Dased pixel mapping function is not an 



sense (i.e. f im {x) * f~\x) ). 



Thus, in one way the formation of tie inverse histogram-based mapping 
function comprises the steps of: constructing a histogram of image pixel 
values, optionally processing the histogram, making an inverse histogram 
from the histogram, optionally processing the inverse histogram, making a 



cumulative inverse histogram from 
processing the cumulative inverse his 



based pixel mapping function from the inverse histogram, optionally 
processing the inverse mapping function, and mapping pixel values using the 
25 inverse histogram-based pixel mapping function, 



The "inversion" can be performec 
alternatively it can be applied to tin 
formation of an inverse histogram 
30 comprise the steps of: constructing 
optionally processing the histograrh 



the inverse histogram, optionally 
ogram, making an inverse histogram- 



on the cumulative histogram, or 
e mapping function. For example, 
based pixel mapping function may 
a histogram of image pixel values, 
making a cumulative histogram, 
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optionally processing the cumulative h 
from the cumulative histogram t optionally 
making an inverse mapping function) 
mapping function and, mapping pixel 
5 based pixel mapping function. 



In constructing a histogram it is possible that regional histograms could be 



used, i.e, a histogram representing a 



stogram, making a mapping function 
processing the mapping function, 
optionally processing the inverse 
values using the inverse histogram- 



localised portion of the image. The 



original histogram may be processed or modified before constructing an 
inverse histogram. Modifications csn also be applied to the inverted 
histogram. In addition, it is also possible to make an inverse mapping function 
from a mapping function derived from the original histogram. It should also be 



noted that the inverse histogram-based 
the pixels within an image or to a se 



15 corresponding to a specific region within an image 



Because the inverse histogram-based 



the inverse histogram via an inverse cumulative histogram, and the 
conventional (non-inverted) histogram-based pixel mapping function is derived 
20 from an image histogram via a cumulative histogram, the inverse histogram- 



based pixel mapping function and 
mapping function share a relationsh 



25 mapping function or from a cumula 



mapping function can be applied to all 
t of image pixels, for example pixels 



pixel mapping function is derived from 



conventional histogram-based pixel 
p with one another, Therefore, as 



explained above, there are various ways to construct an inverse histogram- 
based pixel mapping function from a conventional histogram-based pixel 



ive histogram. For example, if the 



conventional histogram-based mapDing function is differentiated, the 
derivative is inverted (in this context the inversion means subtraction from the 
maximum value) and the result is integrated, the obtained mapping function is 
the inverse histogram-based pixel mapping function- 



In an alternative approach, the inv 



erse histogram-based pixel mapping 



function is produced by subtracting aach value of a cumulative histogram 
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(formed in a conventional manner) 
histogram value. Furthermore, adding 
limitation of the maximum dynamic 
Other modifications can also be a| 
formation of the inverse histogram-! 
should be noted is the principal shape 
the original. Peaks in the original 
the inverse histogram and vice versa 
that regions of high-gradient are trans 
vice versa. 



fron 



em 



a value larger than the maximum 
offset to the maximum value allows 
rjange suppression (no zero slopes). 
3d to the inverted histogram prior to 
pixel mapping function. What 
:>f the inverted histogram compared to 
ram are transformed into troughs in 
n mapping function terms this means 
ormed to regions of low-gradient and 



ppli 3d 



histogi 



Accordingly, the inverse histograrn-bassd pixel mapping function is formed so 



that it has a high slope corresponding 



to low values in the image histogram 



(i.e. pixel value ranges with a small nimber of occurrences) and a low slope 
corresponding to high values in the image histogram (i.e. pixel value ranges 



with a large number of occurrences). 



he effect of mapping input pixel values 



to output pixel values using this kind cf function is that contrast is reduced in 
signal ranges containing a large number of pixels and increased elsewhere. 
This kind of contrast manipulation decreases the visibility of small variations 
and noise in the statistically most important signal ranges. For example, pixel 
value ranges that contain large numbers of pixels typically correspond to 



areas of an image having a substant 
precisely these areas that noise, 
subjectively most visible. 



It has been found that by applying a 



>ixel mapping function constructed from 



an inverse histogram of the imace to the image prior to the edge 
enhancement unit of an unsharp masking block, the problem of amplification 



of noise ordinarily caused by unsharp 
amplification is particularly disturbing 
codec has been used to compress; 



ally uniform intensity or colour. It is in 
*. small variations in pixel value are 



masking is significantly reduced. Noise 
when a JPEG or DCT based hybrid 
the source image, and the present 
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particularly useful when applied to such 



Because inverse histogram-based pixel 
visibility In statistically important signal 



mapping reduces contrast and noise 
ranges, noise enhancement produced 



by unsharp masking is also reduced at these signal ranges. This has an 
advantageous effect, for Instance, when the image contains a relatively wide 
and smooth area. Such an extensive smooth area gives rise to a 
concentration of high values in the image histogram. Inverse histogram- 
based pixel mapping has the effect cf reducing noise amplification due to 
subsequent unsharp masking, particularly in such a large and smooth area. 
Elsewhere the unsharp masking sharpens edges without restrictions. Thus, 
while edges are suppressed in one part of the dynamic range e.g. for pixel 
values representing a large smooth are a, they are enhanced elsewhere in the 
dynamic range. Therefore "real edges" between regions are enhanced 
without restrictions. 

As previously explained, image processing operations often include both 
unsharp masking and a histogram based pixel-mapping algorithm for contrast 
enhancement. In this case, it has be«m found that application of the method 
according to the present invention significantly improves the resulting picture 



quality, Inverse histogram-based pixe 



mapping reduces noise amplification in 



the areas of the image that are emphasised by the contrast enhancement 
algorithm. Due to this feature, both algorithms do not enhance the noise. 

Figure 12 shows an example of an implementation of the present invention in 



which inverse histogram-based pixe 
conventional histogram-based pixel 



mapping is used in conjunction with 
mapping contrast enhancement and 



unsharp masking. A conventional histogram-based pixel mapping contrast 
30 enhancement unit is placed in the original image branch of the unsharp 
masking unit, and a combination of ar inverse histogram-based pixel-mapping 
unit and an unsharp masking unit is Placed in a branch that is parallel to the 
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of 



original image branch. The output 
output of the histogram-based pixel mapping 



Figure 13 shows a modified 
filtering block added in the original 
the contrast enhancement operation, 
reduce the noise introduced by 
enhancement. 



arrangenhent in which an additional (low-pass) 
image branch (into the upper path), after 
The purpose of the filtering block is to 
conventional histogram-based contrast 



A second aspect of the invention is d 
provided a histogram-based pixel 
unsharp masking unit in a branch of ar 
branch being parallel to the original 
branch is added to the original image 
mapping function adapts to the image 
found to be reduced. 



20 the histogram. A video signal consists 



the parallel branch is added to the 
contrast enhancement unit. 



epicted in Figure 15, in which there is 
mapping unit alongside and prior to an 
image enhancement arrangement, the 
irr^age branch. The output of the parallel 
With this arrangement because the 
content, noise enhancement has been 



The present invention may also be applied for enhancement of digital video 
sequences, in which case it is advanlageous to add temporal processing to 



of a sequence of digital images. Each 



image can be enhanced individually, tut the same histogram cannot be used 
for two images that have different content. This means that histograms are 
preferably gathered for each image. However, processing images in the video 
sequence individually produces disturbing flicker, because even quite 
unnoticeable visual differences can cause two images to have substantially 
different histograms, Therefore, temporal processing, for example low pass 
filtering, of the histograms is needec. Typically this kind of processing is 
adaptive to sudden large changes in inpage characteristics, for example due to 
scene-cuts. 

The present invention may be embodied in other specific forms without 
departing from its essential attributes. The inverse histogram-based pixel 
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mapping function of the present invention has been described above in the 



context of a pre-processor for an edge 
present invention may be used on its 



Figure 14 illustrates a number of different applications of an inverse 
histogram-based mapping function unit. Figure 14a shows the inverse 



histogram-based mapping unit applied 



shows the inverse histogram-based masping unit as a post-processing unit for 



an edge enhancement unit Figure 1 
mapping unit as a pre-processing unit 



enhancement function. However, the 
own or in a variety of different ways. 



on its own to an image. Figure 14b 



^ c shows the inverse histogram based 
: or an edge enhancement unit. Figure 



10 14d shows an inverse histogram-based mapping unit in parallel with an edge 



enhancement unit Figure 14e shows 
units, one in an original image branch 



two inverse histogram-based mapping 
and used as a pre-processing unit for a 



low pass filter, and the other one in a parallel branch, as a pre-processing unit 
for an edge enhancement unit. Other inverse histogram-based mapping 
arrangements are possible, in which the method comprises applying the 
image's statistical data-dependent pixal mapping function to the image pixels 



in such a way that image contrast is 



large number of pixels and increased in other signal ranges 



Accordingly reference should be ma<He 
general statements herein rather than 
indicating the scope of invention. 



in 



Furthermore, each feature disclosed 
the claims) and/or shown in the 
independently of other disclosed and/ctr 
invention includes any novel feature^ 
herein either explicitly or any gene 
not it relates to the claimed invention 
addressed. 



reduced in signal ranges containing a 



to the appended claims and other 
to the foregoing specific description as 



this specification (which term includes 
drawirjgs may be incorporated in the invention 
illustrated features* In this regard, the 
or combination of features disclosed 
ralifeation thereof irrespective of whether or 
or mitigates any or all of the problems 
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The appended abstract as filed herewith 
reference. 



is included in the specification by 



What is claimed is: 



